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Original paper 
ABSTRACT 

Aim: The aim of the adoption process of the 
"Quality of hospital care for mothers and new- 
borns babies, assessment tool" (WHO, 2009] 
was to provide the Albanian health profession- 
als of maternity hospitals with a tool that may 
help them assess the quality of perinatal care 
and identify key areas of pregnancy, childbirth 
and newborn care that need to be improved. 
Methods: Four maternity hospitals (one uni- 
versity hospital and three regional hospitals) 
were selected for the assessment using this 
standard tool covering over 600 items grouped 



into 13 areas rangingfrom supportive services 
to case management. Sources of information 
consisted of site visits, hospital statistics, 
medical records, observation of cases and 
interviews with staff and patients. A score 
was assigned to each item (range 0-3) and 
area of care. The assessments were carried 
out in two rounds: in 2009 and in 2011. These 
assessments provided semi-quantitative data 
on the quality of hospital care for mothers and 
newborns. Results: Data collected on the first 
round established a baseline assessment, 
whereas the second round monitored the sub- 
sequent changes. The findings of the second 



round revealed improvements encountered in 
all maternities, notwithstanding differences in 
the levels of improvement between materni- 
ties, not necessarily linked with extra financial 
inputs. Conclusions: The Albanian experience 
indicates a successful process of the adoption 
of the WHO tool on the quality of hospital care 
for mothers and newborn babies. The adopted 
tool can be used country-wide as a component 
of a quality improvement strategy in perinatal 
health care in Albania. 

Keywords: Albania, maternity hospital, qual- 
ity, WHO assessment tool. 



1. INTRODUCTION 

Measurement and assessment of 
health care performance through 
indicators and standards is an ef- 
fective approach for the improve- 
ment of quality of care. The aim of 
the adoption of the "Quality of hos- 
pital Care for mothers and newborns 
babies (QoMNC), WHO assessment 
tool", (from here Tool) was to pro- 
vide Albanian Ministry of Health, 
key stakeholders and partners at 
national level , hospital managers 
and health staff at hospital mater- 
nity level with a tool that help them 
carry out assessments of perinatal 
health care provided at facility level 
in an homogeneous and valid way, 
and ultimately aid them to identify 
key areas of pregnancy, childbirth 
and newborn care that need to be 
improved (1). 



The relevance of the adoption 
of this Tool in the Albanian reality 
consists in the fact that perinatal 
quality of care is a key issue to im- 
prove maternal and neonatal out- 
comes in Albania where access to in- 
stitutional births is nearly universal. 
97 percent of deliveries in the five 
years preceding the Albania Demo- 
graphic and Health Survey 2008- 
09, took place in a health facility 
(INSTAT, 2010). Neonatal mortality 
changed a little over the 15 years pre- 
ceding the ADHS 2008-09, 15 deaths 
per 1000 live births in 1994-1998 and 
11 deaths per 1000 live births in 2004- 
2008 (INSTAT 2010). The slow prog- 
ress in neonatal mortality indicates 
for quality gaps in perinatal care. 

This tool can be used to assess 
quality of perinatal care at country- 
wide level, for a sample of facilities 



or for a single maternity hospital, as 
a component of the quality improve- 
ment strategy in perinatal health 
care. It can be used to assess actual 
clinical practice and quality of care 
before and after interventions in- 
troduced to improve practice and 
quality of care such as WHO and in- 
ternationally recommended guide- 
lines into clinical practice as well 
as for incentives and accreditation 
schemes. 

This standard-based Tool pro- 
vides a semi-quantitative assess- 
ment of the quality of care in a va- 
riety of key areas grouped in 13 ones 
ranging from supportive services to 
case management. The Tool is built 
on and adds up to the experience of 
implementing Making Pregnancy 
Safer Programme and Effective 
Perinatal Care training package ob- 
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tained by WHO regional office for 
Europe and also in the implementa- 
tion of the pediatric hospital care as- 
sessment tool in more than 20 coun- 
tries. (1, 2, 3). 

Adoption of the tool in question 
is realized by an Albanian Working 
Group within the framework of the 
broader project "Support to ma- 
ternal, newborn and child health re- 
form" 2008-2012 aimed at improving 
maternal and child health care in 
Albania, implemented by Ministry 
of Health of Albania with support 
from WHO Albania Country office. 

Field testing of the Tool was con- 
sidered as the heart of the adoption 
process. 

2. METHODS 

2.1. Institutional context 

Improving maternal and children 
health and reducing maternal and 
childhood morbidity and mortality 
are top priorities of Albanian Heath 
System. The existence of a quality 
gap is the most likely explanation 
for slow progress of neonatal mor- 
tality in Albania regardless the high 
access to institutional births. The as- 
sessment of the quality of maternal 
and neonatal care is a component 
of the implementation of the WHO 
Making pregnancy safer strategic 
framework in the European region, 
(WHO European Strategic approach 
for making pregnancy safer) which 
includes technical support to coun- 
tries to develop or revise policies, 
laws, norms, regulations and clinical 
guidelines, to strengthen pre and in 
service training, to make an appro- 
priate use of technologies, to estab- 
lish referral system and to introduce 
maternal and perinatal audits (4, 5). 

As per WHO mandate, the 
adoption process was commenced 
upon request by Albania Ministry 
of Health (MoH) through Bian- 
nual Collaborative Agreements 
(BCAs) and carried out in collabo- 
ration between MoH and a variety 
of partners in the framework of the 
project" Support to maternal and 
child health reform" 2008-2012. Im- 
plementation and scaling up of the 
process in question has been insured 
through partnership among MoH, 
WHO, Spanish Agency for Interna- 



tional Development Cooperation. 

2.2. Conceptual approach and 
methods 

The adoption process was guided 
by the aim to adopt a Tool usable 
and relevant to the epidemiology 
and mothers and newborn babies 
health care structures and organiza- 
tion and as well as to local needs and 
resources in Albania. 

Adoption process considered that 
1) the tool was designed to assess 
uniformly/similarly the quality im- 
provement in hospitals of different 
levels from small district maternity 
hospitals to tertiary care centres, 2) 
the national team when planning 
the assessment, should identify in 
advance which sections of the tool 
will be used in hospitals of different 
levels. So, if one chapter or specific 
items of a chapter are not applicable 
in one hospital, it will be sufficient 
to classify the item/s as not appli- 
cable. 

The heart of the adoption process 
is the use of this Tool in assessing the 
quality of perinatal care in 4 mater- 
nity hospitals two times within a pe- 
riod of about 3 years (January, 2009, 
October 2011). 

The two assessments in Albania, 
among the first ones (6) to use the 
maternal and newborn care quality 
assessment Tool, were used to assess 
and monitor the baseline situation 
in 2009 and subsequent improve- 
ments in 2011. Adoption process of 
the Tool in Albania is among the 
first experiences in European region 
of WHO, as well. 

2.3. Hospital sample 

The same four hospitals were as- 
sessed in 2009 and 2011: three re- 
gional maternity hospitals and one 
tertiary referral maternity hospital 
with Neonatal Intensive Care Unit. 
The requirement for this selection 
was the inclusion of three regional 
maternity hospitals and one referral/ 
teaching maternity hospital. 

2.4. Assessment tool 

The Tool (1) through a peer assess- 
ment collects data from the main 
areas which have a great impact on 
maternal and newborn mortality 
and serious morbidity, as well as on 



maternal and neonatal wellbeing in 
order to identify the areas with poor 
or substandard care ensuring the in- 
volvement of managers, staff and pa- 
tients at facility level and Ministry 
of Health in identifying the priority 
areas and/or actions for interven- 
tions. The Tool is a structured indi- 
cator and standard based checklist 
covering 13 main areas: Hospital sup- 
port system, Care for normal labor, 
Caesarian section, Maternal compli- 
cations, Routine neonatal care, Sick 
newborn care , Advanced newborn 
care, Emergency Care, Infection 
control and supportive care, Moni- 
toring and follow up, Guidelines 
and auditing and Access to hospital 
care. Each area includes from 10 to 
over 50 items, totally around 600 
items. The majority of items are de- 
voted to case management (6). Semi- 
structured interviews with mothers 
provides information on the quality 
of the contact between the mothers 
and their caregivers and quality of 
information and counsels provided 
to them, as well as it explores what 
can be done to improve their well- 
being and that of their baby. 

Involvement of hospital managers 
and staff in identifying the key areas/ 
actions for interventions is ensured 
from semi- structured interviews 
with them. These interviews explore 
the knowledge and the use of guide- 
lines, provide information on orga- 
nizational issues, on critical areas 
for interventions and on immediate 
mid and long term improvements 
that should happen. 

The Tool uses four sources of in- 
formation: hospital statistics, pa- 
tients files, direct observations of 
case management, interviews with 
mothers and staff. 

Each item is evaluated with the 
information gathered by different 
sources to reach an overall score to 
each main area of care. For scoring, 
numbers from 3 to 0 are attributed 
to each item based on the following 
criteria, 3 = good or standard care 
corresponding to international stan- 
dards (no need for improvement or 
need for marginal improvement); 
2 =substandard care but no signifi- 
cant hazard to health or violation 
of human rights (need for improve- 
ment); 1 = inadequate care with sig- 
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Stage 



Draft of the Tool 



Activities 

Appointment of the Working Group 
(Decree ofthe Minister of Health Health, 
no.33, 18.01.2010, 

Literature review, recognizing and discussion 

ofthe Tool within the group 

RUMBA Analysis ofthe tool for Albanian 

context 

First draft (January 2011] 
Round tables on the "Relevance and validity of 
the Tool in the Albanian perinatal care context" 
(March-May 2011) 



Actors 

Working Group, 
Ministry of Health, 
National Institute of Public 
Health, Medicine Faculty, 
National Center of Quality, 
Safety and Accreditation of Health 
Institutions, 

Health Insurance Institute, 
University 

Obstetric-Gynecologic 
Hospitals; 

Regional Hospital Maternities 



In 4 maternities supportive regular 
participatory, supportive and supervisory 
visits to 4 maternities on EPC implementation 
and internal use ofthe Tool and drafting 
respective improvement and implementation 
plans, February-September 2011, including: 
Training internal assessors on the use ofthe 
Tool; 

Testing Technical exchange visits amongthe 4 

maternity hospitals managers and staff. 
II Assessment (October 2011] 
Revision of I Draft (November -December 
2011] 

Consulting the international experts 

Discussion and consensus on their comments 

(March, 2012] 

Final draft (April, 2012) 

Official informed dissemination ofthe Tool to 
Official all Maternity Hospitals (2012). 

endorsement Planning assessment of other maternities in 

the near coming future (2012). 



Working Group, 
Ministry of Health, 
4 maternity hospitals; 



Ministry of Health 



nificant health hazards (need for 
substantial improvement); 0 = very 
poor care with severe hazards to the 
health of mothers and/or newborns 
(need for very substantial improve- 
ments of the structure, organiza- 
tion, procedures and case manage- 
ment related to specific items or to 
the whole area). 

The Tool is built on and adds 
up to the experience of imple- 
menting Making Pregnancy Safer 
Programme and Effective Perinatal 
Care training package obtained by 
WHO regional office for Europe, to 
the previuos experience on criterion 
base audits of obstetric care (7) and 
also in the implementation of the 
pediatric hospital care assessment 
tool in more than 20 countries (8, 9). 

The reference standards for the 
case management assessment of 
the Tool are the WHO Integrated 
Managament of Pregnancy and 
Childhood (IMPAC) manuals of 
the global Making Pregnancy Safer 
Programme (WHOIMPAC Man- 
aging Complications in Pregnancy 
and Childbirth, WHOIMPAC Preg- 
nancy, childbirth, postpartum and 
newborn care) and the Effective Peri- 
natal Care (EPC) training package 
developed by the WHO Regional 
office for Europe and JSI/USAID 
(WHO Regional Office for Europe 
Effective Perinatal Care training 
package) (10, 11). 

2.5. Assessment team 

The assessment team was com- 
posed of international professionals 
and national ones covering all key 
disciplinary backgrounds including 
obstetrics, midwifery and neona- 
tology. 

2.6. Assessment methods 

First, the Tool was translated 
into Abanian. The managers of the 
hospital selected for the assessment 
was sent the information with the 
request to fill in the sections of the 
Tool covering the general informa- 
tion on volume of work, delivery 
indicators and hospital support sys- 
tems (availability of drugs, supplies 
and equipment). 

The visit started with an initial 
briefing to key staff and managers on 
the objectives and methods of the as- 



Table 1. Tool adoption process 

sessment that included all maternity 
hospital services from pharmacy to 
laboratory and clinical units from 
admission to intensive care. 

One assessing visit lasted one and 
a half day. The assessors met after the 
visit to discuss the findings, award 
scores and to prepare the meeting at 
the end of the assessing visit with the 
participation of hospital managers, 
heads of departments/units and sup- 
port services to present and discuss 
main findings and recommended 
actions. 

2.7. Analysis 

Considering the qualitative na- 
ture of the assessment, no statis- 
tical analysis was done with excep- 
tion of calculation of average scores 
award to each main area of care. A 
detailed analysis of the findings was 
performed per each institution. The 
findings of the first assessment and 
the second one were aggregated and 
compared as good evidence in favor 
of the adaptation process. 

Between two assessments, adap- 
tation process applied participatory 
approach through field visits, direct 



observations and interviews with 
health care providers, directors/ 
chiefs and mothers in 4 Maternity 
Hospitals assessed, including here 
training of internal assessors carried 
out during the period February-Sep- 
tember 2011. 

Three structured workshops with 
key informants from Ministry of 
Health, National Institute of Public 
Health, Medicine Faculty, National 
Center of Quality, Safety and Ac- 
creditation of Health Institutions, 
Health Insurance Institute, Univer- 
sity Obstetric-Gynecologic Hospi- 
tals and from all Regional Hospital 
Maternities were held in the period 
March-May 2011. Consultancy with 
the authors (WHO experts) of the 
original tool evaluated the correct- 
ness and validity of the adaptations. 

During the adaptation there were 
compared Tool's items with the re- 
ality of Albanian maternities clinical 
practice: case management, hospital 
records, patient's file, hospital statis- 
tics, drugs, equipment and lab test 
available. Table number 1 shows the 
main steps of the tool adoption pro- 
cess. 
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Areas 


Number of maternity hospitals 
showing standard care (out of a 


Average score 
hospitals) 


all 4 




total of 4 


) in each main area 






2009 


2011 


2009 


2011 


Hospital support systems 


0 


0 


1,25 


1,5 


Maternity and neonatal ward 


0 


1 


1,4 


2 


Normal Labour 


0 


0 


1,36 


1,5 


Caesarean section 


0 


0 


1,56 


1,5 


Maternal complications 


0 


0 


1,65 


1,5 


Routine neonatal care 


1 


1 


2,4? 


2,25 


Sick newborn care 


1 


2 


1,8 


2,5 


Advanced newborn care 




1 


NA 


3 


Emergency care 


0 


1 


1,92 


2 


Infection control and supportive care 


0 


0 


1,62 


1,5 


Monitoring and follow-up 


0 


0 


1,12 


1,?5 


Guidelines and auditing 


0 


0 


1 


1,5 


Access to hospital care 


0 


0 


1,5 


2 



Table 2. Numbers of maternity hospitals showing standard care and average scoresintheareas covered by the 
assessment in 2009 and 2011 



Access to hospital care 
Guidelines/protocolsand auditing 
Monitoring and follow-up 
Infection control and supportive care 
Emergency care 
Advanced newborn care 
Sick newborn care 
Routine neonatal care 
Maternal complications 
Caeserean section 
Normal labour 
Maternity ward/nursery and neonatal. 

Hospital support systems 




2011 
2009 



Figure 1. Overall comparison of findings per each area between two assessments 



3. RESULTS 

The assessments covered facili- 
ties providing care to on average of 
23,5% in 2008 to 26% in 2010, of the 
total number of deliveries per year 
respectively 36251 and 33856. The 
number of deliveries per hospital 
ranged from 1081 to 4138 in 2008 
and from 1198 to 4222 in 2010. 

Overall the quality of care was 
found substandard in all areas in two 
assessments. Table 2 shows numbers 
of maternity hospitals with standard 
care and average scores in the areas 
covered by the assessment in 2009 
and 2011. This tables shows that the 
overall average score per each main 
area has increased for 8 out of 12* 
ones and decreased slightly for 4 
areas. Overall comparison of find- 
ings per each area between two as- 
sessments is presented on Figure 1. 

The overall average score of case 
management related areas (Normal 
labor and delivery, Caesarean sec- 
tion, Maternal complications, Rou- 



tine neonatal care, Care of sick new- 
born babies, Infection control and 
supportive care, Use of guidelines 
and auditing practices, Monitoring 
and follow-up and Access to hospital 
care) in 2009 go from 1 to 2,47 and 
in 2011 from 1,5 to 2,5. 

In 2011 there were no areas with 
an overall average score under 1.5, 
infrastructural and procedural re- 
lated areas of care and case manage- 
ments ones. 

Overall Neonatal care (Routine 
neonatal care, Sick newborn care 
and Neonatal Intensive care) in 2011 
scored better (>2) in comparison 
with other areas of care. 

Overall Neonatal care including 
Routine neonatal care, Sick new- 
born care scored better in 2011 than 
in 2009 (2,4 versus 2,1 respectively). 

Maternal care including Care for 
normal labor and Maternal Compli- 
cations, scored as a whole equally in 
two assessments (1,5 in 2009 and 1,5 
in 2011). 



In 2011 the neonatal care scored 
as a whole better than maternal care 
(2,4 versus 1,5 respectively) than in 
2009 (2,1 versus 1,5, respectively) and 
Advanced newborn care was classi- 
fied as standard (scored 3). 

Overall, the average scores were 
slightly higher in the referral hos- 
pital with respect to other ones in 
2011 than in 2009 (respectively 2,23 
versus 1,66, and 1.9 versus 1,43. 

In 2009 only one hospital (the re- 
ferral one) had two areas of care clas- 
sified as standard. In 2011 two Mater- 
nity Hospitals (one regional Mater- 
nity Hospital and one referral one) 
had each of them three areas of care 
classified as standard. 

The tool used in 2009 was the 
Draft of the Tool and assessed 12 
areas of care. The tool used in 2011 
was the final version, which assesses 
as a separate area of care namely the 
"Advanced newborn care" where ap- 
plicable. 

The average scores for each area in 
all 4 maternity hospitals are shown 
in Table nr.3 In the Maternity hos- 
pital S with exception of one area 
(Emergency care) the rest of areas 
of care scored better than in 2009. 
Three main areas were classified as 
standard. In this Maternity hospital 
was found a slight decrease of Cae- 
sarean section rate (from 23,6% to 
23,2%) in comparison with other 
maternities where number of SC in- 
creased. 

Overall, there is a slight im- 
provement in 2011 with respect to 
2009. The highest proportion of the 
overall average score between two 
assessments at hospital level was for 
Maternity Hospital S 1,4 (2,25 in 2011 
versus 1.6 in 2009). 

In most but not in all mater- 
nity hospital assessed was reported 
a slight decrease in perinatal and 
neonatal mortality, but the quality 
of data is substandard and contra- 
diction exists with information col- 
lected locally. 

Main infrastructural and proce- 
dural issues identified consistently 
in 4 maternity hospitals were: lack 
of national guidelines and local pro- 
tocols for doctors and midwives/ 
nurses for major conditions, lack 
of rational policy for antibiotic use 
for treatment and prophylaxis, in- 



ACTA INFORM MED. 2012 DEC; 20(4): 226-234/ ORIGINAL PAPER 



Adoption of the WHO Assessment Tool on the Quality of Hospital Care for Mothers and Newborns in Albania 



Maternity Maternity Maternity Maternity 

Hospital K Hospitals Hospital V Hospital U 





2009 


2011 


2009 


2011 


2009 


2011 


2009 


2011 


Hospital support 
Systems 


1 


1 


1,5 


2 


1 


1 


1,5 


2 


Maternity and 
neonatal ward 


1 


2 


2 


3 


1 


1 


1,75 


2 


Normal labour 


1.2 


1 


1,5 


2 


1 


1 


1,75 


2 


Caesarean section 


1 


1 


1,5 


2 


1 


1 


2,75 


2 


Maternal 
complications 


l,b 


1 


1 c 

1,3 


9 
C 


1, D 


-1 
1 


9 

C 


9 

C. 


Routine neonatal 
Care 


2,4 


2 


2,5 


3 


2 


2 


3 


2 


Case management 


















and sick newborn 


1,2 


2 


2 


3 


1 


2 


3 


3 


care 


















Advanced newborn 


















care/ 




N/A 




2 




N/A 




3 


Intensive Care Units 


















Emergency obstetric 
Care 


1,7 


2 


2 


2 


2 


1 


2 


3 


Infection prevention 
and supportive care 


2 


1 


1,5 


2 


1,5 


1 


1,5 


2 


Monitoring and 
follow up 


1,5 


1 


1 


2 


1 


2 


1 


2 


Guidelines and 
Auditing 


1 


1 


1 


2 


1 


1 


1 


2 


Access to hospital 
Care 


1,5 


2 


1,5 


2 


1,5 


2 


1,5 


2 



Table 3. Average scores foreachareaofcarein4 maternity hospitals in 2009 and 2011 



adequate provision and utilization 
of equipment, Inappropriate indi- 
cations for caesarean section, lack 
of continuity of care and flow of 
information between primary care 
and hospital, insufficient communi- 
cation and information to mothers 
and their families. 

Main case management issues 
identified were inadequate provi- 
sion and utilization of equipment, 
inappropriate indications for cae- 
sarean section, Lack of national clin- 
ical guidelines and local protocols 
on indications and procedures, In- 
appropriate use of technology and 
interventions, lack of continuous 
medical/nursing education and su- 
pervision on neonatal resuscitation 
and Neonatal Intensive Care Unit 
knowledge and skills; Referral cri- 
teria and systems and communica- 
tion between levels of care not ap- 
propriately in place. 

3.1. Beneficiaries' perceptions 

Interviews to 14 women in 4 ma- 
ternity hospital during the II as- 
sessing visits (pregnant women or 
new mothers or mothers of ad- 
mitted children) provided informa- 
tion on a number issues including 
access to hospital, coordination and 
continuity of care, perceived quality 
of care and information received 
at admission during hospital stay 
and at discharge, physical comfort, 
emotional support, involvement of 
mothers and families in decision 
taking. 

The overall sense of improve- 
ment in four hospitals was expressed 
clearly by the mothers gave birth to 
a previous baby before 2009 (first 
assessment). The interviews with 
mothers confirmed the findings of 
the assessment: the best perceived 
quality of care from mothers was 
found in the maternity hospital 
overall scored higher and in areas 
of care scored higher and classi- 
fied as standard (routine neonatal 
care, sick newborn care, Intensive 
neonatal care and information to 
mothers and mother and baby cen- 
tered care). Comparing the infor- 
mation provided by mothers inter- 
viewed in 2009 with that provided 
in 2011 there is an improvement per- 
ceived and experienced by mothers 



particularly regarding the general 
environment and friendly care for 
both mothers and babies (presence 
of the partner during labor and de- 
livery, mothers were allowed to take 
different positions, to eat and drink 
during labor and delivery), general 
improvement of some basic ameni- 
ties and services for mothers and 
babies, more and better informed 
mothers, adequate information re- 
lated to breastfeeding. But this re- 
ality wasn't present in four hospi- 
tals. The lack of and/or the need 
for more adequate information, in- 
sufficient support during labor and 
delivery, and inconsistent support 
for early initiation and continua- 
tion of breastfeeding and lack of 
companion during labor remained 
the most common complaints men- 
tioned by the interviewed mothers. 

3.2. Health professionals' 
perceptions 

During the assessment 26 health 
professionals were interviewed: 7 ob- 
stetricians (2 chief of hospital mater- 
nity), 6 midwives, 6 neonatologists (3 
chief of the neonatal ward, one chief 
of NICU), 7 neonatal nurses (1 Head 
nurse of neonatal ward, 2 NICU 



nurses). These interviews provided 
interesting insights into issues re- 
lated to quality of care. The informa- 
tion provided from these interviews 
confirmed the findings of the assess- 
ment and took into light a number 
of issues faced by the staff. Critical 
issues for quality, were consistently 
identified, such as: lack of national 
guidelines and local protocols and 
the not regularly use of the existing 
ones; lack of an effective collabora- 
tion between different levels of care: 
primary health care, public and pri- 
vate out-patient services and hos- 
pitals; insufficient communication 
with and information to mothers 
and their families; lack of staff in 
certain areas (neonatology, doctors 
and nurses); insufficient training 
both on the job and through sched- 
uled Continuous Medical Education 
activities. 

The majority of the interviewees 
expressed positive attitude regarding 
the participatory peer to peer ap- 
proach. They acknowledged the nov- 
elty of the method in comparison 
with inspectional assessment expe- 
rienced previously. They acknowl- 
edged the role of the assessment 
Tool in identifying areas and specific 
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Areas 



Actions at hospital level 



1. Improvement in the accuracy 
of in-hospital data collection 



Better recording of patient monitoring and follow up in patient records, 

particularly in nurse chart in neonatology. 

Better recording of the CS decision particularly in one maternity. 

Ongoing efforts to analyze the data at department level in compliance 

with TOOL indicators (Use of Babies* matrix in one maternity; 

Proposal to MoH that basic indicator system as per the TOOL to 

be measured and reported at all levels and to be used for both 

administrative and practice improvement. 

Ongoing development of national clinical guidelines for obstetrics/ 

midwifery and neonatology and local protocols, (particularly for 

neonatology); 

Acceptance and use of international standards related to delivery 
demedicalization; 

Application of baby friendly hospital principles; 

Improved communications with mothers and families; leaflets of info 

for mothers; 

Acceptance and raising the need to set up perinatal referral system as 

per criteria for access to the different levels of hospital care (there was 

one maternity with good experience on the use of this system based on 

the well defined medical conditions covered by them). 

Satisfaction of the rooming-in, early breasfeeding (skin to skin contact, 

breastfeeding during first hour of life) requirements, more or less in all 

maternities; 

Motivating environment for the work in group: training and follow- 
up sessions with involvement of all professionals team members. 
Supporting and application of regional anaesthesia. 



2. Increase in quality 
improvement activities 



3. Revision of policies and 
procedures 



Establishment of National Working Group for Perinatal Care 
Reform 

Initiating job description and/or sharing responsabilities and 
assignments among members of the team; 

Midvives rotation; Planning procedure (drugs and supplies) based on 
volume of 

work, medical conditions and standard-sets of the Tool. 
Development of different work protocols f.e: description of actions of 
(neonatogy) nurses in the delivery room; Development of neonatology 
nurse chart and its 

endorsement from the hospital [one maternity), 

Effective perinatal care (EPC) training courses and the development of 

action plans to implement EPC technologies; 

EPC Follow-up workshops; 

Training internal assessors on the use of the TOOL. 

Regular participatory monitoringvisits to 4 maternities on EPC 

implementation and internal use of the Tool and drafting respective 

improvement and implementation plans; 

Technical exchange visits amongthe 4 maternities managers and staff; 
Identifying areas for future training: 
Internal regulartrainings: 

Hand washing, newborn resuscitation. Coubselling/communication, 
partograph documentation, first aid actions during postpartum 
bleeding etc 
External: 

EPC trainings for academicians, managers; 
Evidence based medicine; 
Evidence based guidelines development; 
Development of local treatment protocols; 

Development and implementation of guidelines for referral to different 
levels of services; 

Data collection, analysis and their use as a guide for ction; 



4.Training activities 



5. New staff positions 



6.Alteration to equipment 



Neonatologist/s; 
Neonatology nurse; 

Anestesiologist available to maternity 24 hours; 

Planning appropriate equipment/Prioritizing equipment to the level of 

hospital care. Planning equipment based on standard-set of the TOOL. 



Table 4. Mat emit y hospitals' responses to tool monitoring. *Babies A Newborn Health Management 
Information System: www.care.org 



organizational issues, practices, pro- 
cedures, and protocols that needed 
to be improved. Some comments 
emphasised that implementing the 
recommendations of the first as- 
sessment "The way of working has 
changed: team work, communication 
and attitude to the patients; demedical- 
ization of labour, more safety during 
labour", 

Useful suggestions for further 
improvements were expressed 
clearly:"We need national guidelines 
officially approved by Ministry of 
Health to be used as a guider in the 
local adaptation process" 

"Mothers should be informed better 
on delivery before she comes to the ma- 
ternity hospital from public and pri- 
vate primary health care structures of- 
fering care for pregnant women: what is 
offered in the maternity hospital, about 
breastfeeding and contraception" 

"Public and private primary health 
care structures offering care for preg- 
nant women should be also part of such 
exercises aiming at improving maternal 
and newborn health care". 

Some comments emphasised that 
the Tool has been not only an assess- 
ment tool, but also a guide to prac- 
tice effective perinatal care prin- 
ciples and standards on day by day 
basis. 

Some professionals emphasized 
the new, non judgemental sup- 
portive approach and the fact that 
the use of the Tool to assess areas 
that require the collaboration of 
various teams and services was pro- 
moting a more collaborative ap- 
proach among professionals. 

3.3. Maternity Hospitals' responses 
to Tool Monitoring 

Along with quantitative data, re- 
assessment revealed qualitative in- 
formation on actions taken in re- 
sponse to monitoring with the Tool. 
The follow-up reassessment (2011) of 
these actions confirmed improve- 
ments in both patient management 
and outcome (for example, a slight 
decrease of perinatal and neonatal 
mortality in four Hospitals). The re- 
sponsiveness of the hospital is the 
best measure of the value of an in- 
dicator (13) in our case of the Tool. 
Overall, the actions induced by the 
tool monitoring are grouped as fol- 



lows (14) in the Table 4 Maternity 
hospitals' responses to tool moni- 
toring. 

The assessment process led to the 
identification of key quality gaps 



and priority actions at Maternity 
hospital level as well as national 
level according to four main health 
system functions: stewardship and 
governance, resource generation, fi- 
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Systems for quality 
assessment/Certification, 


Tool 




accreditation 






Important financial 


Change of daily clinical 


Requirements 


investment to meet the 


routine of all the 


standards; specifically 


perinatal team-heart of the 




trained professionals 


improvement. 


Source of information 


Infrastructure, equipment, written 

procedures and 

protocols, 


Mainly related to case 
Management 


Involvement of hospital 
staff 


Limited; 

Process is more popular among 
managers; 


Participatory approach 
based on peer review 



Feedback to the hospital , . 

Not immediate 

staff 



nancing and service delivery (WHO, 
World health report 2000), (WHO 
European ministerial Conference 
on health Systems, 2008) (15, 16). 

4. DISCUSSION 

The assessment carried out in a 
sample of 4 maternity hospitals in 
Albania in 2011, overall showed that 
the quality of care for mothers and 
newborn babies was substandard 
in all the areas explored, but com- 
paring with the findings of the as- 
sessment in 2009 there are some 
improvements happened in all Ma- 
ternity Hospitals (4) assessed, in the 
interval (less than 2 years) between 
two assessments. 

Overall, there has been a gen- 
eralized improvement in the envi- 
ronment and friendly care for both 
mothers and babies. There was a 
general improvement in some basic 
amenities and services: availability 
of cold and warm water, toilets and 
basic supplies such as soap and an- 
tiseptics; there have been improve- 
ments in the availability of essen- 
tial drugs and laboratory support, 
rooming-in almost a rule in all ma- 
ternity wards. 

Findings of the interviews with 
mothers confirm an overall posi- 
tive direction of change regarding 
the communication and informa- 
tion to them and their families as 
a consequence of a better recog- 
nition of such rights among man- 
agers and health professionals and 
higher awareness of their implica- 
tions for health and wellbeing of 
both mothers and babies. The find- 
ings showed that improvement are 
not the same for all Maternity Hos- 



Immediate 



pitals but in some cases substan- 
tial improvements had taken place 
in key aspects of case management 
(care during normal labour and de- 
livery, and care for sick newborn ba- 
bies), with improvements of appro- 
priate procedures and abandonment 
of inappropriate ones. For example, 
percentage of episiotomy decreased, 
enema is not provided routinely, 
choice of position during labour and 
delivery is allowed. 

In most, but not all centres, a 
slight decrease was reported in peri- 
natal and neonatal mortality, but 
quality of data is substandard and 
some contradictions exists with in- 
formation that is collected locally. 

It was noticed that there was a 
slight decrease in the number of 
caesarean sections in one Mater- 
nity Hospital S (23,6% to 23,2%), in 
comparison with the rest where the 
number of caesarean sections was 
increased. 

Areas (such as essential neonatal 
care, case management of sick new- 
born care and neonatal intensive 
care and) related to newborn baby 
care, still obtained better scores, 
compared to other areas: all over 
scored 2 and more. 

In two maternities the poorest 
performances were observed in key 
aspects such as the management of 
normal labour and delivery, CS, ma- 
ternal complications, infection con- 
trol, availability and use of appro- 
priate guidelines, monitoring and 
follow-up, audit systems. 

Infrastructure, staffing, equip- 
ment, availability of essential drugs 
and supplies and provision, distribu- 
tion and utilization of equipment 



were often found substandard and 
sometimes inadequate. 

However, as previously reported 
in CEE/CIS countries and elsewhere 
(8, 16), these deficiencies did not 
seem to represent the main limiting 
factor to ensure safety, effectiveness, 
and patient responsiveness, i.e. the 
main dimensions of quality care (17). 

The findings of the assessments 
revealed widespread and important 
weaknesses in cross-cutting compo- 
nents of care e.g. availability and the 
use of updated national guidelines 
and local protocols, case reviews and 
audits, which do not require sophis- 
ticated infrastructure or equipment. 

Many of the identified deficiencies 
can be effectively addressed at local 
level, others, such as those regarding 
perinatal referral system, standards 
and norms, national clinical guide- 
lines, equipment, pre-service and in- 
training, require primarily action at 
MoH and/or at government level. 

The quality gap in the care for 
mothers and newborn babies is in- 
creasingly recognized as a priority 
(18, 19). Many systems for quality 
assessment and improvement, cer- 
tification and accreditation systems 
included, have been proposed, im- 
plemented and evaluated, in Europe 
and elsewhere (19, 20). The Table 
5 shows the differences between 
these systems and participatory ap- 
proaches based on peer review that 
the Tool applies. 

The table shows that the use of 
the Tool seems to be more prom- 
ising because the financial implica- 
tions are less, sources of information 
are daily clinical set of files and the 
driving forces are the motivation of 
professionals through their involve- 
ment and developing their profes- 
sionalism as a solid base for contin- 
uous quality improvement (6). 

The limitations of the approach 
are related to the facts that the com- 
parability of the findings among 
health facilities cannot be com- 
pletely guaranteed first, neverthe- 
less the scoring system is based on 
clear criteria and the continuity of 
the evaluation team was ensured; 
second, the sample of hospitals was 
based on Ministry of Health defi- 
nitions, with possible bias towards 
the better performing institutions. 



Table 5. Differences between systems for quality assessment and the tool 
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However, the main purpose of the 
assessment was not to guarantee 
the maximum of accuracy and re- 
producibility, but rather to prompt 
quality improvement cycles through 
a participatory identification of key 
deficiencies and relevant actions to 
address them. 

5. CONCLUSIONS 

Official endorsement of the Tool 
in Albania was based on "live" expe- 
rience of its use. There were experi- 
enced into Albanian reality of ma- 
ternity hospitals the appropriateness 
and relevance of the Tool: case man- 
agement direct observation, hospital 
records, patient's file, hospital statis- 
tics, drugs, equipment and lab tests 
available. 

The use of the Tool in two Assess- 
ments, improvements inspired by 
the measuring process was the best 
supporting evidence of the validity 
of the use of this Tool in hospital 
care for mothers and newborn ba- 
bies in Albania. 

The findings revealed the fact that 
the improvements after first Assess- 
ment were encountered in 4 Ma- 
ternity Hospitals but the level of 
improvement is different amongst 
them. These differences are likely 
to be linked with different orga- 
nizational ways of working, with 
the variable level of responsibility 
and readiness of maternity/hospital 
leadership to internalize the quality 
continuous improvement require- 
ments and to inspire and maintain 
a supportive environment for the 
working group spirit and for recog- 
nizing and creating the due space to 
each member of the team providing 
care for mothers and newborn ba- 
bies. The assessing process revealed 
that improvement of clinical man- 
agement of normal childbirth and 
complicated cases is just starting and 
the pace of improvement is slow be- 
cause it involves changing practices 
and attitudes of staff, which usually 
requires a longer time to be imple- 
mented. 

The experience and the positive 
trend towards the quality improve- 
ment of hospital care for mothers 
and newborn babies, assessed using 
the Tool, showed that this approach 
is a feasible and effective way to mon- 



itor quality improvements, build 
awareness on quality issues and pro- 
moting change at facility level but at 
the same time at system level. 

During the adoption of the Tool 
and/or assessment/ reassessment of 
the quality of 4 Maternity Hospitals 
(over a two- year period), national 
capacities have been strengthened 
which is an added value of this pro- 
cess for scaling up the approach to 
all maternity hospitals. 

The experience of the use of the 
Tool showed that it's crucial a) to 
adopt a multiprofessional approach, 
which necessarily should include 
midwifes and nurses, b) to involve 
hospital directors and staff in a peer- 
to-peer supportive approach and c) 
to support the development and im- 
plementation of action plans at fa- 
cility level. 

Official endorsment of the Tool, 
created the institutional conditions 
to link the use of this approach with 
the certification/accreditation and/ 
or continuous improvement quality 
process. 

The supportive and participatory 
approach applied by the Tool, was 
particularly welcome and confirmed 
by professionals who had previously 
experienced only bureaucratic con- 
trols and sanctions. 

Improvements identified and 
measured, "live" experience of 4 Ma- 
ternity Hospitals in identifying key 
areas of pregnancy, childbirth and 
newborn care that need to be im- 
proved and the experienced validity 
of the use in the quality continuous 
improvement of the Tool in ques- 
tion, are the main reasons that the 
adopting process was successful. 
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